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Abstract — The increasing availability of distributed energy 
resources (DERs) and sensors in smart grid, as well as overlaying 
communication network, provides substantial potential benefits 
for improving the power system's reliability. In this paper, 
the problem of sensor selection is studied for the MAC layer 
design of wireless sensor networks for regulating the voltages 
in smart grid. The framework of hybrid dynamical system is 
proposed, using Kalman filter for voltage state estimation and 
LQR feedback control for voltage adjustment. The approach to 
obtain the optimal sensor selection sequence is studied. A sub- 
optimal sequence is obtained by applying the sliding window 
algorithm. Simulation results show that the proposed sensor 
selection strategy achieves a 40% performance gain over the 
baseline algorithm of the round-robin sensor polling. 

I. Introduction and Motivation 

Ordinary electrical grids in many countries are undergoing 
a revolutionary change of evolving to smart grids, which are 
characterized by a two-way flow of electricity and information 
and will be capable of monitoring everything in the grid [2]. 
By bringing in a variety of Distributed Energy Resources 
(DERs), in particular renewable sources such as solar panels 
and wind turbines, smart grid addresses both globe warming 
and emergency resilience issues. 

In this paper we study the wireless communication protocol 
design for regulating the voltages in smart grid which has a 
shared communication channel among control center, voltage 
sensors and DERs. The feasibility of DER for regulating 
voltage has been well reported in the literature, such as [6] . As 
shown in Fig. Q] multiple sensors monitor the voltage states at 
{V a , Vb, ■ . ■ } and report the states to the voltage control center. 
Based on all received reports, the control center estimates the 
voltage states. If the estimated voltage state is deviated from a 
preset desired value, the control center coordinates all available 
DERs to regulate voltage. The arrival of new report from 
sensor triggers the control center to perform another round 
of voltage state estimation and regulating. The above iterative 
voltage regulating process continues until the the voltages are 
within a desired range. 

The motivation of our work is the increasing availability 
of DERs, voltage sensors, and the overlaying communication 
network in power networks [1]. Although the voltage regu- 
lation for power system stability has been a critical problem 
under intensive study [4]-[7], the new properties and potential 
benefits brought by these new facilities still need more effort to 
uncover. Take the microgrid as an example [3], in which DERs 
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Fig. 1 : Distributed Energy Resources for Voltage Control 

have demonstrated their abilities of increasing power quality 
and reliability in practical systems; however, developing alter- 
native control strategies using next-generation information and 
communication technology is still an open question. Existing 
solutions for the voltage control problem with DERs either 
focus on analyzing the power system model or mainly study 
control method design, e.g., the Model Predictive Control 
(MPC) [4], [5] or PID controller [6], [7]. 

We will focus on the MAC layer design of the wireless 
sensor networks for the voltage regulation. When orthogonal 
communications are required, i.e., only one transmitter can 
access the channel at the same time and collisions incur packet 
losfl it is of key importance to study the problem of sensor 
selection. A simple solution is to use round-robin scheduling, 
i.e., the sensors take regular turns to report their measurements, 
regardless of the current voltage states. However, as will be 
seen later, a significant performance gain over the simple 
scheme will be achieved by manipulating the sensors in a 
system state aware manner. Particularly, we will model the 
power grid as a hybrid system [8] [11], in which the power 
system is the continuous subsystem while the communication 
system is the discrete subsystem. The sensor selection will 
be considered as the switching of the system dynamics mode. 
Then, we apply a sliding window algorithm to optimize the 
sensor selection, or equivalently, the system mode selection. To 
our best knowledge, there have not been any studies applying 
the hybrid system theory to the communication protocol design 

'it is straightforward to extend to the case that multiple sensors can be 
scheduled simultaneously 



in smart grid. 

The remainder of the paper is organized as follows. In 
Section |IIJ we introduce the modeling of power system with 
sensors reporting through a shared communication channel, 
as well as the formulation of the voltage control problem. In 
Section [HI] we describe the voltage control procedures and 
the algorithm for optimizing the sensor selection in the MAC 
layer. An example application and its simulation results will be 
reported in Section [IV] The conclusions are given in Section 

II. System Model and Problem Formulation 

In this section, we first introduce the system model, includ- 
ing the power dynamics, system cost and communication sys- 
tem. Then, we formulate the problem as three sub-problems. 

A. Power System Dynamics 

We use the following differential-algebraic equation (DAE) 
to describe our target power system, which is given by 

x = /(x,u,w'), w'~Af(0,Q'): (1) 

where x G 1" is the system state representing the voltages; 
u G W n is the system control action; w' is the system 
process noise which is assumed to be zero-mean, Gaussian and 
white with co variance matrix Q' . Since the voltage is usually 
required to stay within a narrow range centered at a desired 
value, we assume that the function / can be well approximated 
by its linearization in the neighborhood of desired voltage 
values. 

When voltage fluctuations due to either fault in the system 
or load change, DERs are able to provide compensation to 
regulate the voltages. Note that the action taken by a DER, 
say increasing its voltage, can affect all voltages in the system, 
more or less. Hence, a single DER as an individual actuator 
cannot reduce the voltage oscillation efficiently, as it does not 
have the global information on the voltage state. Therefore, to 
enable the DERs to collaboratively regulate the power system 
voltages, we must first obtain as much information as possible 
about the overall voltage state, and then assign the tasks of 
voltage adjustment to each DER accordingly. 

There exists a group of sensors, Si, ... ,5^, ... , Sn, moni- 
toring voltage change in the power system. Each is able to 
obtain a partial observation of the system with its unique 
measuring function, which is given by 

y l = hi(x,v{), vJ~AA(0,i?a i = l,...,N, (2) 

where yi denotes the measurement obtained by sensor Sf, hi is 
the measuring function associated with S,; vj is the Gaussian 
measurement noise with zero mean and co variance matrix R[. 
We assume that v[ is independent of the system process noise 
w'. 

With the controlled voltage staying close to preset desired 
value, we consider a discrete-time linearized model derived 
from aforementioned DAE. The time continuous functions / 



and hi are locally linearized around desired voltage x*, which 
are given by 

*k =/(x^_ 1 ,u^_ 1 ,0) + A(x fc _i -xjU) (3) 
+ J B(u fc _ 1 -u*_ 1 )+Fw'. 

and 

y ik = hi(x* k ,0) + H lk (x k - x* k ) + G^, i = 1, . . . ,N, (4) 

where A, B, F, Ha- and Gi are matrices derived from the Jaco- 
bian matrices of / and hf, x. k _ 1 = x? = x*. Calculation of the 
Jacobian matrices and discrete-continuous model conversion 
are standard procedures [9] [10]. Since at the steady state, 
the voltages stay at desired values and the control action is 
not needed, we have uf j = and f(x* k _ 1 ,u* k _ 1 ,0) = x*, 
/ii(x£,0) = y*. Substitute them into Eq. © and Eq.® 
respectively, we have 

x fc = x* + A(x fe _i - x*) + Bun + Fw', (5) 

and 

Yik = y* + H ik (x k - x*) + Gtv'i, i = 1, . . . , N. (6) 

Letting Ax fc = x fe -x*, Ay lk = y ifc -y*, w = Fw' and v> = 
Gv^, we obtain the voltage deviation based system equation 
(|7]i and the measurement equation (0, which are given by 

Ax fc = AAx fe _i + Bun + w, w ~ JV(0, Q), (7) 

Ay ifc = H ik Ax k + v h v, ~ Af(0, R,),i = 1,...,N, (8) 

where Q = FQ'F T , Ri = GiR'fiJ '. Q represents the power 
system uncertainties which may be due to variations in the 
power system parameters, the effects of nonlinearities and the 
dynamics that have not been included in the power system 
model. Ri reflects the uncertainties of sensor i's measurement 
mainly because of noise. 

B. System Cost 

We define the time discretized cost function for the system 
as a quadratic function which penalizes the voltage deviation 
and minimizes control cost, which is given by 

k=K 

J = E( (Ax^Ax fc + ulEu k )), (9) 

k=l 

in which, k = 1 ~ K is the entire voltage adjusting period. D 
and E are positive definite matrices whose weighting elements 
depend on power system's penalties for voltage deviations at 
different buses and different DERs' operating costs. 

C. Communication System 

We assume that the sensors can report their measurements 
to the control center equipped with a base station. The center 
can then compute the corresponding actions and send them 
to the DERs. Due to the expensive cost of wired communi- 
cations, we assume that wireless communication technologies 
are employed. To avoid the possible collisions, the reports 
from the sensors are conveyed in a polling manner, i.e., the 
control center schedules the transmission of the sensors. For 



simplicity, we assume that only one sensor can be scheduled 
in a time slot and it is straightforward to extend to the 
case of multiple scheduled sensors. Moreover, we ignore the 
communication details like modulation and coding, as well as 
the transmission delay and packet drops, thus focusing on the 
sensor selection in the MAC layer. 

D. Problem Formulation 

Our focus is to find an effective algorithm for selecting 
the voltage sensors. To that end, three subproblems have to 
be studied towards solving our problem of timely regulating 
voltage with minimum operating cost: i) how to obtain the 
optimal system state estimation with partial observation from 
chosen sensors; ii) what control method should be applied 
based on the estimated system state; iii) which sensor to 
choose at each time slot and what is the selection criterion. 

III. Optimal Sensor Selection Sequence 

In this section, we present our algorithm of sensor selection 
for the voltage control by employing the framework of hybrid 
dynamical systems [11]. We will first introduce the theory of 
hybrid dynamical systems. Then, we will explain the algorithm 
of sensor selection. 

A. Hybrid Dynamical System 

Hybrid dynamical system (HDS) is a dynamical system 
which consists of both discrete and continuous dynamics. 
While continuous dynamics come from continuous subsystems 
of HDS, discrete dynamics are from the switching among these 
subsystems. Thus, the interaction between the discrete and 
continuous dynamics is the focus of HDS study. 

One well known method of describing hybrid dynamical 
systems is using a set of ordinary differential equations with 
the following format: 

x(t) = / ? (x) (10) 

in which, x(£) £ R" is the system state; i = 1, 2, . . . , N is 
the switching system mode, and /i, /2, • ■ • , /jv are continuous 
functions determined by the corresponding subsystems in the 
HDS. 

Most dynamical systems around us are hybrid dynamical 
systems. Especially with advancement of modern digital tech- 
nology, numerous systems have been equipped with computer 
based controller with digital-sampling blocks, which inevitably 
changes these systems into HDS. One example of such HDS 
is robotic system. It uses camera or other sensors to monitor 
surrounding environment, and chooses the optimal operating 
mode accordingly. Being a practical analysis model for a 
variety of modern systems, HDS has received intensive studies 
in the literature [15]— [17]. 

B. Sensor Selection Algorithm 

The power voltage control system under our study belongs 
to an important class of hybrid dynamical system called 
switching system, in which the continuous variables are the 
state variables of all continuous time subsystems and the 



discrete variables are the indices of subsystems. Specifically, 
in our power system, the continuous variables are the voltage 
states while the discrete variables are the indices of the chosen 
sensors. 

We use feedback control to regulate the voltage. Since at 
any given time slot only one sensor can report, the power 
system is always under partial observations. To perform the 
feedback control, an estimation of overall voltage state has to 
be obtained first. The feedback control equation is given by 

u fc = -L k x x fe = -L k x g{y ik ), (11) 

where u k is the control input; L k is the feedback control 
matrix; x^ = g(yi k ) is the state estimation based on sensor i's 
measurement y^ k and previously received measurements; g(-) 
is the estimation function. From (0, (0 and ( TTTT i. we have 

Ax fc+ i = A x Ax fe -BxL k x g(H ik Ax k +Vi)+w. (12) 

With Eq. (fT2l . we revisit the three subproblems (section III-DI) 
to be solved for achieving our ultimate goal of sensor selection 
in voltage control: i) function g(-) gives system state estima- 
tion; here we use Kalman filter; ii) feedback matrix L k rep- 
resents control method for which we adopt Linear Quadratic 
Regulator (LQR); iii) Hi k indicates the choice among different 
sensors. The following three subsections address these three 
individual problems. 

1) Kalman Filter for State Estimation: The Kalman filter is 
a set of mathematical equations that provide an efficient recur- 
sive computational means to estimate the state of a process by 
minimizing the mean square error [13]. The state estimation 
process has two main interactive procedures: process update 
and measurement update whose mathematical expressions for 
our specific voltage control problem are Eq. (Q~3} and Eq.(fl4l 
respectively, namely 

Ax" = AAxn + J3u fc _i, (13) 

and 

Ax fc = Ax" + K k (y ik - flftAx-), (14) 

in which Ax^ is the preliminary voltage deviation estimation 
based on the system state dynamics in (O with control input 
applied; Axt is the refined voltage deviation estimation after 
incorporating the correction provided by current measurement 
Yik\ K k is the Kalman gain matrix which can be calculated 
beforehand according to Eq. ([TBI , namely 

K k = P k -Hf k {H ik P^Hl + Ik)- 1 , (15) 

where P k = AP k _iA T + Q is the predicted estimation covari- 
ance which is iteratively updated by P k = (I — K k Hi k )P k ■ 

2) LQR for Feedback Control: With the latest state estima- 
tion available from Kalman filtering, we use Linear Quadratic 
Regulator (LQR) [14] to control the deviated voltage to the 
desired value. Being an effective control method in solving 
problem with linear system model and quadratic cost function, 
LQR is a good fit for voltage control. In fact, LQR, together 
with the Kalman filter, forms a Linear Quadratic Gaussian 
(LQG) problem. By LQG separation principle [12], we are 



able to decouple the voltage state estimation from LQR control 
and calculate feedback matrix L k in advance by Eq. < IT6b . 
which avoids posing a substantial computation burden on 
voltage control center. 



L k = (E + B T AI k B)- 1 B T M k A, 



(16) 



in which A and B are system matrices in Eq. (IT); E is the 
control input cost matrix in the cost function (0; M k is found 
iteratively backwards in time by using the following equation: 

M fe _ x = D + A T (M k - M k B(E + B T M k B)- 1 B T M k )A, 

(17) 

with initial condition Mk = D, and D is the voltage deviation 
cost matrix in the cost function (9). 

3) Sensor Selection: Now we face the key challenge of 
sensor selection. We denote the sensor querying sequence 
by I = {ii, . . . ,i k , . . . ,i K } for k = 1 ~ K, and i k e 
{1, . . . , N}. Since the measurement of the current selected 
sensor, together with all previous sensor reports, determines 
the voltage control input which in turn determines the voltage 
states, the system cost function (0 becomes a function of /. 
Hence, our goal is to minimize the overall cost by finding an 
optimal sensor querying sequence /, i.e., 



k=K 



min{J(I) = E( 



k=l 



(Ax^Ax^+u^Ui))}. (18) 



According to the separation principle of LQG problem, 
its optimal control is totally based on the accurate state 
estimation. Therefore the optimal sensor querying sequence 
is the one that can achieve the minimum voltage deviation 
estimation error. The estimation error covariance is given by 



P k = E[(Ax fc - Ax fc )(Ax fc - Ax fe ) 



(19) 



From k = 1 to k = K, our goal consequently becomes 
finding the optimal (or near optimal) sensor querying sequence 
/ which minimizes overall estimation error, which can be 
written as 



k=K 

min{ 

fc=i 



trace{P k )}. 



(20) 



By employing Eq. ( TT3T > and the iterative updating process 
for Kalman gain K k , the estimation error covariance evolves 
as follows: 



Pk 
Pk 



= [I- P k Hlk{H lk P k Hf k + RA-'H^P-, (21) 
= AP k -iA T + Q. (22) 



The initial value Pq can be an approximate one which reflects 
estimation accuracy of given xrj. 

Starting from the selection of sensor at k = 1 until the 
voltage is adjusted to the desired value at k = K, we have N 
choices in each step. Thus, we can grow a tree structure for 
all possible sensor querying sequences. To find the optimal 
sequence, one straightforward but inefficient method is the 
brute force strategy which traverses all sequences and selects 
the one with the minimum estimation error as required by (|20) . 
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Fig. 2: Example Power System Model 

While it guarantees to find the optimal sequence, the brute 
force strategy suffers the exponential increase of computational 
cost. 

We seek a trade-off between the sub-optimality sensor 
sequence and reasonable computation effort by adopting the 
sliding window algorithm [18]. Given a window size d(steps), 
the algorithm proceeds as follows: 

1) Initialization: start from root node with time k = 1. 

2) Traversal: 

a) Traverse all the possible paths in the tree for the 
next d levels from the present node; 

b) Identify the optimal sensor sequence within the d- 
window; 

c) Put the first sensor of the optimal sequence into 
the output sensor sequence. 

3) Sliding the window: 

a) If k = K then quit, otherwise go to the next step; 

b) Use the sensor which has just been selected as the 
new root; 

c) Update time k = k + 1; 

d) Repeat the traversal step. 

In the algorithm, the window size d is an adjustable parameter 
determining the trade-off between the sequence optimality and 
computational cost (or the speed of decision making). Larger 
window size d results in a better sensor sequence but more 
computational intensity, and vice versa. As pointed out in 
[18], when we slide the window, the first d — 1 steps' error 
covariances in the new window have already been calculated in 
the previous window and are available for immediate use. This 
merit of the algorithm considerably reduces computational 
demand. 

IV. Example Application and Simulation Results 

In this section, we use an example application of power 
voltage control (Pig. [2j to demonstrate the effectiveness of our 
proposed sensor selection strategy. In this example application, 
three voltage controlling/regulating DERs and three voltage 
monitoring sensors are installed in the power system. The 
system matrices in the power system equation (UJ are give 
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Voltage Control with Sensor Selecting Strategy 



A 



B 




0.6 0.1 
0.1 0.7 
0.2 0.15 




(23) 



(24) 



Elements in A being larger than 1 means that, without timely 
curbing voltage deviated from desired value, the state in 
the system will keep deteriorating. B shows that action of 
any single DER affects the state of the entire power system 
and DERs' control capabilities are coupled with one another, 
though each DER has its own primary control area. The 
covariance matrices of the system process noise w and the 
sensor measurement noise v are given by 



(25) 
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(26) 



The noise power at sensor 3 is set to be much larger than 
those at the other two sensors, because we want to show that 
our sensor selection strategy is able to compensate the inferior 
condition by optimally allocating the shared communication 
channel. We also give voltage deviation penalty matrix D and 
control input (DER operation) cost matrix E in (O, which are 
given by 



D = 
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(27) 



We set the initial voltage deviation as Axo = [30, 10, 20] T , 
and use two different methods to perform the sensor selection: 
one is using our proposed sensor selection strategy which 
returns the sensor querying sequence below; the other is to 
use the round-robin polling {2 3 1 2 3 1...}, and this method 
is used as our baseline. The sliding window size d is set as 
d= 5. 

Sensor querying sequence: {123313231313213 
312313123131321331231312 3} 

TableUgives the communication channel allocation statistics 
for all three sensors. Sensor 3 receives the highest utilization 
percentage of the channel, i.e., 45% of channel accesses, while 
sensor 1 and sensor 2 receive 35% and 20% respectively. 
According to the noise covariance matrices Q and R, sen- 
sor 3 suffers the highest level of measurement noise which 
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Fig. 3: Voltage State Evolution. Controlled by sensor selection strategy, 
deviation of voltage is eliminated by the time k = 30; Without the strategy, 
deviation still exists after k = 40. 




Fig. 4: Cost Comparison. The method with sensor selection strategy reduces 
cost by approximately 40% compared with the method using round-robin 
sensor polling 

is overwhelming compared with the other two's; thus it is 
granted the highest utilization percentage. Sensor 1 has a lower 
measurement noise but higher process noise than sensor 2; 
consequently, sensor l's combined noise effect gives it larger 
channel utilization percentage (35%) than sensor 2 receives 
(20%). 

Fig. [3] depicts the voltage state of the system during the 
control process using both methods. The lower figure uses the 
round-robin polling, and the upper figure shows results using 
our proposed strategy. Both methods successfully pull the 
deviated voltage back to the desired value (deviation becomes 
zero), while our method forces the voltage to converge faster, 
in particular for voltage 3 (the green line). 

Approaching the desired voltage x* faster results in less 
time staying deviated from x* and thus reduces the cost. 
Fig. 2] shows the costs for both voltage control methods. 
Our proposed strategy outperforms the baseline of round-robin 
algorithm by reducing the cost by approximately 40%. 

One of the key reasons that our sensor selection method 
is able to beat the round-robin method is that our method 
achieves smaller voltage state estimation error, as demon- 
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Fig. 6: Voltage State Transition, round-robin sensor polling results in 
moderate state fluctuation (the upper curve); voltage state controlled by sensor 
selection strategy has smoother transition (the lower curve). 

strated in Fig. [5] The more accurate state estimation of our 
proposed algorithm helps the control center to timely use 
DERs to adjust voltage states and reduce the state fluctuation. 
In Fig. |6l the voltage state controlled by the round-robin 
method, namely the upper curve, has moderate fluctuation 
from time k = 5 to k = 25; while the voltage state 
controlled by our sensor selection strategy, the lower curve, 
shows smooth transition. Furthermore, the voltage state with 
a smoother transition like the one controlled by our sensor 
selection strategy is much more desired. 

V. Conclusion and Future Work 

In this paper, we have treated the power system with sensors 
and shared communication channel as a hybrid dynamical 
system, which switches its mode by selecting different sensors. 
The approach to obtain the optimal sensor querying sequence 
has been analyzed by minimizing overall system cost. Both 
LQR control and Kalman filter have been applied for the 
control. A sub-optimal but computational efficient sliding 
window algorithm has been applied and has been demonstrated 
to achieve a 40% performance gain compared with the simple 
round-robin sensor polling baseline. 

We did not consider more details of the communication 
system, e.g., the delay and packet drop rate. In the future, we 



will study how these factors affect the system performance 
of voltage control. Moreover, we assume a base station is 
available for the information processing and communication 
scheduling. In practical system like microgrid, it may be 
more desirable to eliminate the necessity of such a base 
station due to its expensive cost. Hence, we will study the 
sensor scheduling in a complete decentralized communication 
infrastructure in smart grid. 
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